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CN ■ Abstract 

^ I The hitting time is the required minimum time for a Markov chain-based walk (classical or 

quantum) to reach a target state in the state space. We investigate the effect of the perturbation 
^^ ' on the hitting time of a quantum walk. We obtain an upper bound for the perturbed quantum 

walk hitting time by applying Szegcdy's work and the perturbation bounds with Wcyl's pertur- 
bation theorem on classical matrix. Based on the definition of quantum hitting time given in 
(~| . MNRS algorithm, we further compute the delayed perturbed hitting time (DPHT) and delayed 

Qh' perturbed quantum hitting time (DPQHT). We show that the upper bound for DPQHT is ac- 

tually greater than the difference between the square root of the upper bound for a perturbed 

C ' random walk and the square root of the lower bound for a random walk. 

C^ ■ 

— \'. 1 Introduction 



Markov chains and random walks have been useful tools in classical computation. One can use 
l/^ I random walks to obtain the final stationary distribution of a Markov chain to sample from. In such 

^^ . an application the time the Markov chain takes to converge, i.e., convergence time, is of interest 

because shorter convergence time means lower cost in generating a sample. Sampling from station- 
ary distributions of Markov chains combined with simulated annealing is the core of many clever 
f^ ■ classical approximation algorithms. For instance, approximating the volume of convex bodies [T], 

approximating the permanent of a non-negative matrix [2], and the partition function of statistical 
physics models such as the Ising model [3] and the Potts model [4j. In addition, one can also use 
the random walks to search for the marked state, in which the hitting time is of interest because 
^ ■ hitting time indicates the time it requires to find the marked state. 
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In comparison to classical random walk, quantum walk provides a quadratic speed-up in hitting 
time. Quantum walk has been applied to solving many interesting problems [5], such as search- 
ing problems, group commutativity, element distinctness, restricted range associativity, triangle 
finding in a graph, and matrix product verification. Perturbations of classical Markov chains are 
widely studied with respect to hitting time and stationary distribution. Since a quantum system 
is susceptible to the environmental noise, we are interested to know what effect perturbation has 
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on currently existing quantum walk based algorithms. 

This work is organized as follows. In section [2] we present the deviation effect of perturbation 
on the spectral gap of a classical Markov chain. In section [3] we discuss how the hitting time 
would be affected because of the perturbation. We explore the upper bounds for the perturbed 
hitting time quantumly and the time difference (delayed perturbed hitting time) both quantumly 
and classically. Finally in section HI we make our conclusion. 

2 Classical Spectral Gap Perturbation 

Given a stochastic symmetric matrix P £ C"^", we can quantize the Markov chain [^. P. Wocjan, 
D. Nagaj and one of us showed that the implementation of one step of quantum walk [7j can be 
achieved efficiently. However, the above settings always are under the assumption of perfect sce- 
narios. In real life there are many sources of errors that would perturb the process. Noise might 
be propagated along with the input source or they might be introduced during the process. Here 
we look solely at the noise that are introduced at the beginning of the process. 

The noise can be introduced due to the precision limitation and the noisy environment. For in- 
stance, not all numbers have a perfect binary representation and the approximated numbers would 
cause perturbation. Suppose our input decoding mechanism can always take the input matrix and 
represent it in a symmetric transition matrix Q, where Q can be perfectly represented and this is 
the matrix closest to the original matrix P that the system can prepare. 

Let E be the noise that is introduced because of system's precision limitation and the environ- 
ment, we can express the transition matrix as 

Q = P + E. (1) 

Classically, much research [HI [H [lOl [TTl [121 E] has focused on the spectral gaps and stationary 
distributions of the matrices with perturbation. In a recent work by Ipsen and Nadler [8] , they 
refined the perturbation bounds for eigenvalues of Hermitians. Throughout the rest of the paper, 
II • II always denotes the I2 norm, unless otherwise specified. Based on their result, we summarized 
the following: 

Corollary 1. Suppose P and Q £ C"^" are Hermitian symmetric transition matrices with respec- 
tive eigenvalues 

0<A„(P)<...<Ai(P) = l, 0<A„(Q)<...<Ai(Q) = l, (2) 

and Q = P + E, then 

max |Ai(P)-Ai(Q)| < ||^||. (3) 

l<i<n 

Furthermore, the spectral gap 5 of P and the spectral gap A of Q have the following relationship 

6 - \\E\\ < A < 6 + \\E\\. (4) 



Proof. Eq. ([3]) is a direct result from the Weyl's Perturbation Theorem. The Weyl's Perturba- 
tion Theorem bounds the worst-case absolute error between the ith exact and the ith perturbed 
eigenvalues of Hermitian matrices in terms of the I2 norm |101 [TT] . And since 

1 - A2(P) = 6, 1 - \2{Q) = A, (5) 

by eq. ([3]) we have |(5 — A| < ||-E||. Therefore, in general we can bound the perturbed spectral gap 

A as 

5- ll^ll < A < 5 + ||£;||. (6) 

D 
Generally speaking, the global norm of E might be very large when the dimensions n >> 1 
|14j . However, in our case because E is the difference between two very close stochastic symmetric 
matrices, its global norm would never become large. 

3 Hitting Time of Markov Chain Based Walks 

For the purpose of being complete, we need to cite several definitions and results used in the MNRS 
algorithm |15j in this section. We recommend interested readers to reference |15j for details. 



Let P be a reversible and ergodic transition matrix with state space Q and positive eigenvalues. 
Suppose P is column-wise stochastic and \Q\ = n, then let the Markov chain {Xi, . . . ,Xn) under 
discussion have a finite state space and transition matrix P. 

Definition 1. For x £ Q, denote the hitting time for x 

HT{P, x) = mm{t >l:Xt = x}. (7) 

HT{P, x) is the expected number of transition matrix P invocations to reach the state x when started 
in the initial distribution vr. 

Definition 2. For annxn matrix P, P-x denotes the (n— 1) x (n — 1) matrix of P where the row 
and column indexed by x are deleted. For a vector v, V-x is the vector that omits the x-coordinate 
of V. Similarly, suppose {M} = {xi, . . . ,Xm}, then P„r^/} denotes the {n — m) x (n — m) matrix 
of P where the rows and columns indexed by xi,X2, ■■ ■ ,and Xm are deleted. 

Definition 3. Denote the vector space T-L = C'^'^'^'. For a state \ip) G Ti, define H^ = |V')(V'I O'^ 
the orthogonal projector onto Span(\ip)). Let A = Span{\y)\py) : y £ Q) be the vector subspace of 
% where 

A is spanned by a set of mutually orthogonal states {\ipi) : i = 1,2 . . . ,\rt\}, then let n_4 = ^- H^, . 
Similarly, A-x = Span{\y)\py) : y G r2\{x}}. 



Definition 4. The unitary operation W{P) = (5- (2n_4 — I))^ defined onTi is the quantum analog 
of P- Similarly, the unitary operation W{P,x) = {S ■ (2n_4_^ — /))^ defined on Ti is the quantum 
analog of P^x- S is the swap operation defined by S\y)\z) = \z)\y). 

Fact 1. IMW ^(^t^^^ and\n) = \x)\px). Let U2 = S'(2n^ - /) and Ui = I - 2\fi){fi\. When P 
is reversible, then [/| = W{P) and {U2Uif = (5(2n^_^ - I)f = W{P,x). 

^\Q. 



Proof. Since n^ = [Jjyli^y^x \y)\Py) {y\{Py\) + l/^)(/^l' then we have 

U2U1 = S(2IiJ^-I){I-2\^i){^l\) 

= s{2IlJ^-2\^l){^l\-I) 

= S{2Iij,_^-I) 

3.1 Classical Hitting Time 

By [15], the x-hitting time of P can be expressed as HT{P,x) = it' {I — P-x)~^U-x, where u is an 
all-ones vector. It is known that 

7riM-p-xr'u, = ,/jr;^{i-s.xr'v'i^ (9) 

where S-x = V^^-xP-xV^^-x with II.^. = diag['Ki)i-^x and J'k_x is the entry-wise square root 
of Ti-x- Let {vj : j < n — 1} be the set of normalized eigenvectors of S-x where the eigenvalue of 
Vj is Xj = cosBj with < 6j < 7r/2. By reordering the eigenvalues, let us assume that 1 > Ai > 
• • ■ > A„_i > 0. When i/vrZ^ = J2j ^j^j is the decomposition of y^vrZ^ in the eigenbasis of S-x, the 
x-hitting time satisfies: 

HTiP,x) = ^-^. (10) 

j ■' 

Two simple facts can be observed from above description of classical hitting time. 

Fact 2. S-x oind P-x o,Te similar, they have the same eigenvalues. 

Fact 3. Since the entries of distribution vr sum up to 1 , i.e. X^j('7rj) = 1, then it is obvious that 
V^-x-V'^-2; = Y.i{'^i)i^x < 1- Hence we know that ^^ vf = Y.\^\ ^'^■ 



3.2 Delayed Perturbed Hitting Time 

In this subsection, we define the delayed perturbed hitting time and its upper bound as the following. 

Lemma 1. For a Markov transition matrix P with state space Vi and limiting distribution vr. 
Assume \Vi\ = n and let \vi) be the eigenvector with corresponding eigenvalue Aj of P-x. Suppose 
the eigenvalues of P-x are ordered such that 1 > Ai > A2 > . . . > A^-i > 0. The x-hitting time 
satisfies 

HT{P,x) = Y,-^ (11) 



where J't^-x = X^lJi ^j\'Vi)- When given a perturbed matrix Q where \\Q — P\\ < \\E\\ then the 



■1] 
Delayed Perturbed Hitting Time (DPHT(P,Q,x)) is bounded from above by 



l-Ai-||£;||2 l-Ai+7 
where Ai — A^-i = 7. 



(12) 



Proof. Let the eigenvalues of Q-x be Aj. By the fact HQ — -P|| < ||-E^|| and Weyl's perturbation 
theorem, we know that \\Q-x — P-x\\ ^ \\E\\ and |Aj — Ai| < \\E\\. The delayed hitting time due to 
perturbation is thus 

DPHT{P, Q, x) = HT{Q, x) - HT{P, x) 



= 
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l-Ai-ll-Ell l-Ai + 7 



(13) 
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the last inequality is a result from FactlM 

3.3 Upper Bound for Perturbed Quantum Hitting Time 

Given two Hermitian stochastic matrices, P and Q, we explore the difference between walk oper- 
ators, W{P) and W{Q), with respect to their hitting time. Denote the set of marked elements as 
\M\. Based on the result from CoroUaryUl we have the following: 

Corollary 2. Given two symmetric reversible ergodic transition matrices P and Q G C"^", where 
Q = P + E, let W{P) and W{Q) be quantum walks based on P and Q, respectively. Let M be the 
set of marked elements in the state space. Denote QHT{P) as the hitting time of walk W{P) and 
QHT{Q) as the hitting time of walk W{Q). Suppose \M\ = eN . If the second largest eigenvalues 
of P and Q are at most 1 — 6 and 1 — A, respectively, then in general 



QHT(P) = 0{^^). QHnQ)^o{^j^-^) (14) 

where 6 - \\E\\ < A<S+ \\E\\. 

Proof. Suppose the Markov chain P, Q and matrix E are in the following block structure 

-(Sp:)' «KSS)' -(IS) 

where we order the elements such that the marked ones come last, i.e., P4, Q4 and E4 G C|7v/jx|Mj- 
The corresponding modified Markov chains [6] would be 

«^(sn^(stin^ 



By [B], we have QHT{P) = OUj^^) and QHT{Q) = 0(a/ i_||q^|| )- Since we know 

llA||<l-y and ||Qi|| < 1 - ^ (17) 

by [6] and by Cauchy's interlacing theorem we have \\E\\ > \\Ei\\ |16^ Cor. III. 1.5], we then obtain 

IIQill < min jllPill + ||£;||, 1 - (l.zM}l\ (18) 

as S — \\E\\ < A < 5 + \\E\\. Therefore, the hitting times for P and Q are derived. D 

From the corollary above, it is clear that the noise increases the the quantum hitting time. By 
a simple comparison with the classical hitting time, we have the following fact. 

Fact 4. When given a perturbed quantum walk W{Q), where the magnitude of noise is \\E\\, the 
quadratic speed-up gained from the quantum walk will be annihilated when \\E\\ > Q{5{1 — Se)). 

3.4 Quantum Hitting Time Based on MNRS Algorithm 

Let U = U2U1 be a unitary matrix with real entries. Let |//) (see Fact [1]) be the marked element 
where Ui = I — 2\fj,){fi\ and U2 is a real unitary matrix with a unique 1-eigenvalue \<p). Similar to 
the classical case, let {(j))-^ = 10) — {(j)\n)\fi). 

The potential eigenvalues for U are then ±1 and conjugate complex numbers (e*"-', e"*"-'). Let 
\(p)-f_i be the input state for the phase estimation of U, then |(/>)-/i can be uniquely decomposed in 
the eigenbasis of U as 

10) _^ = 5o\uJo) + Y, ^j\^f) + '^-il^-i) (19) 

j 

where U\ujq) = |wo)) U\uj-i) = — |c<j_i) and U\ujj) = e "^\u}j). Let QH be the random variable 
which takes the value 1/aj with probability 5^ and the value l/vr with probability (5^^^. 

Definition 5. \15^ The quantum \^)-hitting time of U2 is the expectation of QH, that is 

QHTiU2,\fJ.))=2y2^ + —. (20) 

i •' 

Hence, in order to compute the quantum hitting time of U2, it is important to compute the 
spectral decomposition of U . It is shown in the following theorem. 

Theorem 1. j^ Fix an n x n column-wise stochastic matrix P, and let {|A)} denote a complete 



set of orthonornial eigenvectors of the nxn matrix D with entries Djk = \ PjkPkj with eigenvalue 
{A}. Then the eigenvalues of the discrete-time quantum walk U = S{2Il_/( — I) corresponding to P 
are ±1 andX± iVl - A2 = e±*«'-^™^^ 0. 



^Eigenvalues of D are exactly the eigenvalues of P_{j\f} and eigenvalue 1. 



Let the subset M be the set of marked elements that we are searching for. The discrete-time 
quantum walk C/„{j\/-j, = £'(211^,^^, — /) satisfies the above theorem when we modify the original 
transition matrix P into P in the following manner: 

{1 A; e M and j = k 

keM Slid j ^k 

Pjk k^M 

We can view P in block structure as follows: 

P^{M} P2\ ^ ( P^iKn 

then the corresponding discriminant matrix D is 



^- r 3H ^- r " • (^^' 



i)=(^-l"> »). (22) 

Fact 5. Now let us set M = {x}. Then ±1 and e^*°J are eigenvalues of U-x where Xj are the 
eigenvalues of P-x- Since Xj = cosOj (see sect. \3.1\} . and by use o/ theorem [H we know that 
9j = aj. 

Furthermore, by Fact{l\we know the unitary W{P,x) = U'^^. The eigenvectors of U-x remain 
the eigenvectors of W{P, x) but the eigenvalues of W{P, x) would be e^*"^ . Given \(j))-^ as the input 
state, we run phase estimation of W{P,x) and the corresponding quantum hitting time would be 

n-l ^2 n-1 ^2 

QHTiP, x) = 2Y,^ = Y,f,, (23) 

the term -^ in def. disappears because the corresponding eigenphase becomes 0. 

3.5 Delayed Perturbed Quantum Hitting Time 

In this subsection, we define the Delayed Perturbed Quantum Hitting Time (DPQHT) and its 
upper bound as the following. 

Fact 6. ]15^ When P is an ergodic Markov transition with positive eigenvalues, then the x- quantum 
hitting time for the unitary W{P,x) is 

QHT{P,x) = ^f (24) 

i=i ^ 

Proof. Since the length of the projection of !</>)-« to the eigenspace corresponding to Uj is v'j [15], 
then by eq. [23] we have the result as shown in eq. [Ml 

Lemma 2. Given QHT{P,x) and QHT{Q,x) with \\P — Q\\ = \\E\\, then by use of Fact \^ we 
have the Delayed Perturbed Quantum Hitting Time DPQHT{P, Q, x) bounded from above by 

1 1 

Vl-Ai-T^~ VT-Ai+t' 

The eigenvalues of P-x are ordered such that 1 > Ai > A2 > . . . > A^-i > and Ai — A,i_i = 7. 

7 



Proof. Based on Fact [6l we have 

DPQHT{P, Q, x) = QHT{Q, x) - QHT{P, x) 



~9 2 

(y "^ ) 


-(T ''' 

V^cos-iA„_i 
1 


1 



^1-Ai- II-EII 2Vl-Ai+7' 



(25) 
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The last inequaUty is a simple result from Faci [3 and the fact that 2\/l — A > cos ^ A > \/l — A 
for all AG (0,1). 



4 Conclusion 

By quantizing a perturbed symmetric stochastic n x n matrix Q with noise E, we find an upper 
bound for the perturbed quantum hitting time. We also so show the lower bound for the magnitude 
of noise when the quadratic speed-up gained from the quantum walk will be annihilated by the noise. 

Furthermore we compute the upper bound for the delayed perturbed quantum hitting time 
based on the definition of quantum hitting time. One cannot just directly apply the square root 
speed-up from quantum walk to the delayed perturbed hitting time (see eq. [T3l) . If one does so, 
one would obtain an upper bound for DPQHT as 



1 1 

V^l - Ai - 11^ ~ VT^^JTT^' 



(26) 



It would be incorrect. The second term of eq. [26] should the the minimum of X^jg^ — ^A — • But 
in eq. [26} the second term was actually the maximum. Thus, it is clear that the upper bound for 
DPQHT is actually greater than the difference between the square root of the upper bound for a 
perturbed random walk and the square root of the lower bound for a random walk. 
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